Accessory and mobile computing device communication using an application communication protocol

ABSTRACT

Embodiments of the present invention provide various communication techniques for communication between a mobile computing device and an accessory. An accessory protocol that is generic to the mobile computing device can be used for some communication. An application executing at the mobile computing device can communicate with the accessory using an application communication protocol. In some embodiments, the application communication protocol can be different from the accessory communication protocol. In other embodiments the application protocol may only be recognized by the application and the accessory. In some embodiments, messages conforming to an application protocol can be communicated between the application and the accessory by packaging the messages inside a message conforming to the accessory communication protocol.

CROSS REFERENCE

This application claims the benefit of U.S. Provisional PatentApplication No. 61/160,601, entitled “Accessory and Mobile ComputingDevice Communication Using An Accessory Communication Protocol,” filedMar. 16, 2009, U.S. Provisional Patent Application Ser. No. 61/160,644,entitled “Accessory Attachment Protocol,” filed Mar. 16, 2009, theentire disclosures of which are incorporated herein by reference for allpurposes.

BACKGROUND

The present disclosure relates generally to communication between anaccessory and a mobile computing device and in particular to usingaccessory and/or application specific protocols for such communications.

Mobile computing devices have become ubiquitous. Various companies havecreated mobile computing devices, such as the iPhone™, iPod Touch™,various BlackBerry® devices, and smart phones compatible with Google'sAndroid™ platform, to name a few. Mobile computing devices often includeweb browsers, word processors, email applications, maps, telephoneservices, games, audio applications, video applications, etc. Moreover,accessories have also been created for use with mobile computingdevices. Such accessories can communicate with a mobile computing deviceusing one or more connectors and/or ports. Such accessories can be usedto control features of the mobile computing device or used by the mobilecomputing device to interact with users and/or the environment.

BRIEF SUMMARY

According to various embodiments, an accessory may communicate with anapplication executing on a mobile computing device using an accessoryspecific communication protocol and/or an application specificcommunication protocol. For example, when an accessory couples with amobile computing device it may perform initialization, identification,and/or authentication procedures using an accessory protocol defined bythe mobile computing device. The accessory may also communicateinformation indicating one or more application protocols that may beused by an application executing on the mobile computing device tocommunicate with the accessory. In some embodiments, an applicationprotocol can be different from the accessory protocol, while in otherembodiments an application protocol can be the same as the accessoryprotocol. In some embodiments, an application protocol packet can benested within portions of an accessory protocol packet.

Various embodiments disclosed herein describe methods for creatingcommunication sessions between accessories and applications. Someembodiments describe how an accessory provides the proper informationfor the mobile computing device to open a communication session using anapplication protocol. Other embodiments describe various schemes at themobile computing device for selecting an application protocol, openingcommunication streams, downloading a preferred application,communicating with an accessory, nesting application protocol packetswithin an accessory protocol packet, etc. In some embodiments, anapplication manager executing at a mobile computing device can be usedto abstract the communication between an accessory and an application.

The following detailed description, together with the accompanyingdrawings, will provide a better understanding of the nature andadvantage of the embodiments disclosed herein.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A shows a mobile computing device coupled with an accessory deviceaccording to some embodiments of the invention.

FIG. 1B shows an accessory device wirelessly coupled with a mobilecomputing device according to some embodiments of the invention.

FIG. 2 shows a block diagram of a mobile computing device coupled withan accessory according to one embodiment.

FIG. 3 is a block diagram showing various modules and processes within amobile computing device according to some embodiments of the invention.

FIG. 4 is a simplified diagram further illustrating communicationbetween an application and an accessory according to some embodiments ofthe invention.

FIGS. 5A-5C illustrate an example of packaging an application protocolmessage within an accessory communication protocol command according tosome embodiments of the invention.

FIG. 6 illustrates a path for commands of the accessory communicationprotocol in the embodiment of FIG. 4 according to some embodiments ofthe invention.

FIG. 7 is a flow diagram of a process for identifying an accessory andcompatible application according to some embodiments of the invention.

FIG. 8 shows a connected protocol list and a supported-protocol tableusable to associate compatible applications and accessories according tosome embodiments of the invention.

FIG. 9 illustrates a technique for formulating a query usable to locatea compatible application for an accessory according to some embodimentsof the invention.

FIG. 10 is a flow diagram of a process that can be executed by anapplication to initiate communication with an accessory according tosome embodiments of the invention.

FIG. 11 illustrates an application on a mobile computing deviceconcurrently interacting with two different accessories according tosome embodiments of the invention.

FIG. 12 illustrates two applications on a mobile computing deviceconcurrently interacting with two different accessories according tosome embodiments of the invention.

FIG. 13 illustrates two applications on a mobile computing deviceconcurrently interacting with the same accessory according to someembodiments of the invention.

FIG. 14 illustrates the flow of data between an application, theapplication manager and the hardware transport layer of a mobilecomputing device according to some embodiments of the invention.

FIG. 15 is a flow diagram of a process that can be executed by anapplication manager at a mobile computing device according to someembodiments of the invention.

FIG. 16 is another flow diagram of a process that can be executed by anapplication manager at a mobile computing device according to someembodiments of the invention.

FIG. 17 is a flow diagram of a process that can be executed by anaccessory coupled with a mobile computing device to open communicationwith an accessory according to some embodiments of the invention.

FIG. 18 is a flow diagram of a process that can be executed by anapplication at a mobile computing device to open a communication with anaccessory according to some embodiments of the invention.

DETAILED DESCRIPTION

Various embodiments of the invention disclosed herein are directedtoward various aspects of communication between accessory devices and amobile computing device. In some embodiments, an accessory cancommunicate with a mobile computing device using an accessorycommunication protocol. An accessory communication protocol can specifycommunication commands, transport links, authentication routines,identification processes, lingoes, packet structures, data types, or anyother suitable command or data that can be used to communicate betweenan accessory device and a mobile computing device.

An application executing on a mobile computing device can alsocommunicate with the accessory using an application communicationprotocol. In some embodiments, an application communication protocol canspecify communication commands, packet structures, data types, lingoes,message formats, etc., for communication between the application and theaccessory. In some embodiments, at least some of the communicationcommands, packet structures, data types, lingoes, message formatsspecified by the application communication protocol can be differentfrom those specified by the accessory communication protocol. In otherembodiments, at least some of the communication commands, packetstructures, data types, lingoes, message formats specified by theapplication communication protocol can be the same as those specified bythe accessory communication protocol.

In some embodiments, the application protocol can use the transport linkspecified by the accessory communication protocol. An applicationcommunication protocol can be developed, for example, by the developerof the application and/or accessory. In some embodiments, an applicationcommunication protocol can include application and/or accessory specificcommands, data structures, etc. Furthermore, the terms “applicationcommunication protocol” and “application protocol” can be usedinterchangeably. The terms “accessory communication protocol”,“accessory communication protocol”, “general communication protocol”,and “general protocol” can also be used interchangeably.

FIG. 1A shows a mobile computing device 102 coupled with an accessorydevice 113. Cable 111 is used to couple mobile computing device 102 withaccessory device 113. Cable 111 can include connector 108 to connectwith mobile computing device 102 and connector 110 to connect withaccessory device 113. FIG. 1B shows accessory device 113 wirelesslycoupled with mobile computing device 102.

The mobile computing device shown in FIGS. 1A and 1B, can be any type ofmobile computing and/or communication device without limitation. Forexample, an iPod Touch™, an iPhone™, an Android compatible device and/ora Blackberry device can be used. Moreover, mobile computing device 102can provide media player capability, networking, web browsing, email,word processing, data storage, application execution, and/or any othercomputing or communication functions.

Accessory 113 can be any device capable of communicating with mobilecomputing device 102 such as, for example, an external speaker system;an external video device; a multimedia device; a consumer electronicdevice; a test instrument; a home appliance (e.g., refrigerator ordishwasher); exercise equipment; a security system; a home or officeautomation system; a camera; a user input device (e.g., keyboard, mouse,game controller); a measurement device; a medical device (e.g., glucosemonitor or insulin monitor); a point of sale device; an automobile; anautomobile accessory (e.g., a car stereo system or car navigationsystem); a radio (e.g., FM, AM and/or satellite); an entertainmentconsole on an airplane, bus, train, or other mass transportationvehicle; etc. Any type of device that can be used in conjunction with amobile computing device can be used as an accessory device.

FIG. 2 shows a block diagram of mobile computing device 200 (e.g.,implementing mobile computing device 102 of FIG. 1A or 1B) coupled withan accessory 202 (e.g., implementing accessory 113 of FIG. 1A or 1B)according to one embodiment. Mobile computing device 200 can includeprocessor 230, storage device 225, user interface (UI) 235, networkinterface 236, and accessory input/output (I/O) interface 205.

Processor 230, which can be implemented as one or more integratedcircuits (including, e.g., a conventional microprocessor ormicrocontroller), can control the operation of mobile computing device200. For example, in response to user input signals provided by userinterface 235, processor 206 can perform various tasks such as selectingand playing media assets that may be stored in stored in storage device225; accessing various networks (e.g., a mobile telephone network, theInternet, local area network, or the like) to send and/or retrieve datausing network interface 236; executing various application programs(Apps) 226 residing on storage device 225; and so on. Processor 230 canalso manage communication with accessories via accessory I/O interface205.

User interface 235 can include input controls such as a touch pad, touchscreen, scroll wheel, click wheel, dial, button, keypad, microphone,etc., as well as output devices such as a display screen, indicatorlights, speakers, headphone jacks, etc., together with supportingelectronics (e.g., digital-to-analog or analog-to-digital converters,signal processors or the like). A user can operate the various inputcontrols of user interface 235 to invoke the functionality of mobilecomputing device 200 and can also view and/or hear output from mobilecomputing device 200 via user interface 235.

Storage device 225 may be implemented, e.g., using disk, flash memory,or any other non-volatile storage medium. Storage device 225 can storeapplication programs 226 that are executable by processor 230, systemprograms and other program code (not explicitly shown), and various datasuch as protocol table 227 that can be used in managing communicationwith various accessories, as described below. In some embodiments,storage device 225 can also store media assets such as audio, video,still images, or the like, that can be played by mobile communicationdevice 200, along with metadata describing the media assets (e.g., assetname, artist, title, genre, etc.), playlists (lists of assets that canbe played sequentially or in random order), and the like. Storage device225 can also store any other type of information such as informationabout a user's contacts (names, addresses, phone numbers, etc.);scheduled appointments and events; notes; and/or other personalinformation.

Application programs (also referred to herein as “applications” or“apps”) 226 can include any program executable by processor 230. In someembodiments, certain applications can be installed on mobile computingdevice 200 by its manufacturer, while other applications can beinstalled by a user. Examples of application programs can include videogame programs, personal information management programs, programs forplaying media assets and/or navigating the media asset database,programs for controlling a telephone interface to place and/or receivecalls, and so on. Certain application programs 226 may providecommunication with and/or control of accessory 202, and certainapplication programs 226 may be responsive to control signals or otherinput from accessory 202; examples are described below.

Network interface 236 can provide an interface to one or morecommunication networks. For example, network interface 236 canincorporate a radio-frequency (RF) transceiver and suitable componentsfor communicating via a mobile communication network such as a mobiletelephone network. Additionally or instead, network interface 236 canincorporate a wireless connection to the Internet (e.g., a WiFitransceiver, 3G transceiver or the like), to a personal area network(e.g., a Bluetooth network), or any other network. In still otherembodiments, a wired network connection (e.g., Ethernet) may beprovided. In some embodiments, the same hardware can be used to supportconnections to multiple networks; thus, network interface 236 caninclude analog-to-digital and/or digital-to-analog circuitry, basebandprocessing components (e.g., codecs, channel estimators, and the like),modulators, demodulators, oscillators, amplifiers, transmitters,receivers, transceivers, internal and/or external antennas, and so on.In some embodiments, some operations associated with networkconnectivity can be implemented entirely or in part as programs executedon processor 230 (e.g., encoding, decoding, and/or other processing inthe digital domain), or a dedicated digital signal processor can beprovided.

Accessory I/O interface 205 can include a number of signal pathsconfigured to carry various signals between mobile computing device 200and accessory 202. In one embodiment, accessory I/O interface 205includes a 30 pin connector corresponding to the connector used on iPod®and iPhone™ products manufactured and sold by Apple Inc.; otherconnectors can also be used. Alternatively or additionally, accessoryI/O interface 205 can include a wireless interface (e.g., Bluetooth orthe like).

In some embodiments, mobile computing device 200 can also use accessoryI/O interface 205 to communicate with a host computer (not shown) thatexecutes an asset management program that can provide media and/orapplications for a mobile computing device (for example, iTunes® orMicrosoft's application store). The asset management program can enablea user to add media assets and/or applications to mobile computingdevice and/or remove media assets from mobile computing device 200. Theuser can update metadata associated with media assets on mobilecomputing device 200. In some embodiments, the user can also interactwith the asset management program to create and update playlists and/orapplications as well as other documents. In one embodiment, the hostcomputer maintains a master database of media assets and/or applicationsand can access other databases, for example, through the Internet(including associated metadata and playlists), and the asset managementprogram synchronizes the master database with the database maintained onstorage device 225 of mobile computing device 200 automatically whenevermobile computing device 200 connects to the host computer. In otherembodiments, mobile computing device 200 can use network interface 236to communicate with a host computer and/or directly with various otherservers to acquire applications, media assets and/or other data.

Accessory 202 can include controller 260, user interface 255, mobilecomputing device I/O interface 250, memory 265, and accessory specifichardware 275.

Mobile computing device I/O interface 250 can include a number of signalpaths configured to carry various signals between accessory 202 andmobile computing device 200. In one embodiment, mobile computing deviceI/O interface 250 can include a connector adapted to mate with the30-pin connector used on iPod® and iPhone™ products manufactured andsold by Apple Inc. Other connectors can also be used; for example,mobile computing device I/O interface 250 can include a standard USB orFireWire connector or the like. Alternatively or additionally, mobilecomputing device I/O interface 250 can include a wireless interface(e.g., Bluetooth or the like).

Controller 260 can include, e.g., a microprocessor or microcontrollerexecuting program code to perform various functions such as digitalaudio decoding, analog or digital audio and/or video processing,processing of user input, controlling of accessory functionality and thelike. Controller 260 can also manage communication with a mobilecomputing device via mobile computing device I/O interface 250.

User interface 255 can include input controls, such as a touch pad,touch screen, scroll wheel, click wheel, dial, button, keypad,microphone, probes, etc., as well as output devices, such as a videoscreen, indicator lights, speakers, headphone jacks or the like,together with supporting electronics (e.g., digital-to-analog oranalog-to-digital converters, signal processors or the like). A user canoperate the various input controls of user interface 255 to invoke thefunctionality of accessory 202 and can view and/or hear output fromaccessory 202 via user interface 255. In addition, in some embodiments,a user can operate mobile computing device 200 (or applicationsexecuting thereon) via accessory user interface 255.

Memory 265 can be implemented using any type of memory, disk, or otherstorage medium that can store program code for controller 260 and/ordata. For example, memory 265 can store accessory specific software 280that can provide instructions for controller 260 to interact withaccessory specific hardware 275, and/or user interface 255. In someembodiments, accessory 202 can receive information (e.g., user input,metadata, and/or application data) from mobile computing device 200, andsuch information can also be stored in memory 265.

Accessory specific hardware 275 can represent any hardware needed toenable desired functionality of accessory 202. For example, accessoryspecific hardware 275 can include one or more data gathering devices,such as any type of sensor or meter. In some embodiment, accessoryspecific hardware 275 can include an electrical meter that generatesdata representing electrical characteristics (resistance, voltagedifference, or the like); a light sensor that detects light and/orpatterns of light; a motion sensor; a temperature sensor; a humiditysensor; a pressure sensor; a chemical sensor that responds to thepresence of selected chemicals (e.g., potentially toxic gases such ascarbon monoxide); and so on. Accessory specific hardware 275 can alsoinclude one or more medical device such as a glucose meter, respiratorymeter, heart rate and/or heart function monitor, blood pressure monitor,or the like.

In some embodiments, accessory specific hardware 275 that includes adata-gathering device can provide one or more electrical signals (e.g.,voltage, resistance, and/or current) that correspond to or represent thephysical data. Analog and/or digital signals in a variety of formats maybe used. Accessory specific hardware 275 can also include signalprocessing components that process the signal before sending it tocontroller 260; in some embodiments, accessory specific hardware 275 cansend the electrical signal directly to controller 260, which can processthe signal. For example, if accessory specific hardware 275 includes athermometer implemented using a thermocouple, resistance data from thethermocouple can be converted into temperature data by accessoryspecific hardware 275, by controller 260, or both. Further, signalsrepresenting data gathered by accessory specific hardware 275 can besent (with or without processing by controller 260) to an applicationexecuting on mobile computing device 200, e.g., using an applicationprotocol as described below; thus an application executing on mobilecomputing device 200 can also process data gathered using accessoryspecific hardware 275.

In some embodiments, accessory specific hardware 275 can include one ormore computer-controllable devices. Examples of computer-controllabledevices include motors, actuators, lights, cameras, valves, speakers,display screens, printers, and/or any other equipment that iscontrollable by controller 260. In some embodiments, an applicationexecuting on mobile computing device 200 can send control signals toaccessory 202, and controller 260 can operate accessory specifichardware 275 in response to the control signals.

In some embodiments, accessory specific hardware 275 can includecomponents of user interface 255. Thus, an application executing onmobile computing device 200 can receive user input from accessory 202,provide output to a user via accessory 202, and/or control, interactwith, or respond to any operation accessory 202 is capable ofperforming.

In some embodiments, accessory specific hardware 275 can include networkand/or communication interfaces. For example, accessory specifichardware 275 can include an RF receiver (e.g., for FM, AM, satelliteradio, and/or other bands) and/or an RF transmitter (e.g., a short-rangetransmitter for personal use). In other embodiments, accessory specifichardware 275 can include a communication interface to a personal areanetwork, such as a Bluetooth transceiver or other short-range wirelesscommunication interface. In still other embodiments, accessory specifichardware 275 can include a telephone interface, GSM, CDMA, and/or othervoice and/or data network interfaces.

Accordingly, accessory specific hardware 275 can encompass any hardwarecomponent for which interoperability with a mobile computing and/orcommunication device may be desirable.

It will be appreciated that the system configurations and componentsdescribed herein are illustrative and that variations and modificationsare possible. The mobile computing device and/or accessory may haveother capabilities not specifically described herein. While accessory202 and mobile computing device 200 are described herein with referenceto particular blocks, it is to be understood that the blocks are definedfor convenience of description and are not intended to imply aparticular physical arrangement of component parts. Further, the blocksneed not correspond to physically distinct components.

Accessory I/O interface 205 of mobile computing device 200 and mobilecomputing device I/O interface 250 of accessory 202 allow mobilecomputing device 200 to be connected to accessory 202 and subsequentlydisconnected from accessory 202. As used herein, mobile computing device200 and accessory 202 are “connected” whenever a communication channelbetween accessory I/O interface 205 and mobile computing device I/Ointerface 250 is open and are “disconnected” whenever the communicationchannel is closed. Connection can be achieved by physical attachment(e.g., between respective mating connectors of mobile computing device200 and accessory 202), by an indirect attachment such as a cable, or byestablishing a wireless communication channel. Similarly, disconnectioncan be achieved by physical detachment, disconnecting a cable, poweringdown accessory 202 or mobile computing device 200, or closing thewireless communication channel. Thus, a variety of communicationchannels may be used, including wired channels such as Universal SerialBus (“USB”), FireWire (IEEE 1394 standard), or universal asynchronousreceiver/transmitter (“UART”), or wireless channels such as Bluetooth (ashort-range wireless communication standard developed by the BluetoothSIG and licensed under the trademark Bluetooth®), WiFi (adhering to anyof the IEEE 802.11 family standards), wireless personal area network,infrared, or the like. In some embodiments, communication can occurusing both a wired and a wireless channel. In some embodiments, multiplecommunication channels between a mobile computing device and anaccessory can be open concurrently, or a mobile computing device can beconcurrently connected to multiple accessories, with each accessoryusing a different communication channel.

Regardless of the particular communication channel, as long as mobilecomputing device 200 and accessory 202 are connected to each other, thedevices can communicate by exchanging commands and data as specified byan accessory communication protocol. The accessory communicationprotocol can define a format for sending messages between mobilecomputing device 200 and accessory 202. For instance, the accessorycommunication protocol may specify that each message is sent in a packetwith a header, a payload, and/or a tail. The header can provide basicinformation such as a start indicator, length of the packet, and acommand to be processed by the recipient, while the payload provides anydata associated with the command; the amount of associated data can bedifferent for different commands, and some commands may provide forvariable-length payloads. The packet can also include a tail that mayprovide error-detection or error-correction codes, e.g., as known in theart, and/or other information as desired. In various embodiments, theaccessory communication protocol can define specific commands toindicate an action to be taken by the recipient; to signal completion ofa task, change of state, or occurrence of an error; and/or to identifythe nature of the associated data. In some embodiments, the commands maybe defined such that any particular command is valid in only onedirection.

The accessory communication protocol can also specify one or morephysical transport links usable for transmitting signals betweendevices. For example, the transport link can be a USB link, a UART link,a FireWire link, a Bluetooth link, a WiFi link, a parallel link, aserial link, etc. At this level, the accessory communication protocolcan specify, e.g., start bytes, sync bytes, stop bytes, and/or otherauxiliary signals. In some embodiments, the accessory communicationprotocol can provide for multiple alternative transport links; thus asingle mobile computing device can support communication over a varietyof physical links including wired and/or wireless links.

The accessory communication protocol can define a number of “lingoes,”where a “lingo” refers generally to a group of related commands that canbe supported (or unsupported) by various classes of accessories. In oneembodiment, a command can be uniquely identified by a first byteidentifying the lingo to which the command belongs and a second byteidentifying the particular command within the lingo. Other commandstructures may also be used. It is not required that all accessories, orall mobile computing devices to which an accessory can be connected,support every lingo defined within the accessory communication protocolor every command of a particular lingo (for instance, different devicesmight use different versions of a given lingo).

In some embodiments, every accessory 202 and every mobile computingdevice 200 that are designed to interoperate with each other support atleast a “general” lingo that includes commands common to all suchdevices. The general lingo can include commands enabling the mobilecomputing device and the accessory to identify themselves to each otherand to provide at least some information about their respectivecapabilities, including which (if any) other lingoes each supports andwhich capabilities of the other device each intends to use whileconnected.

The general lingo can also include authentication commands that themobile computing device can use to verify the purported identity andcapabilities of the accessory (or vice versa), and the accessory (ormobile computing device) may be blocked from invoking certain commandsor lingoes if the authentication is unsuccessful. For example, anauthentication manager (not shown) within mobile computing device 200can communicate with an authentication controller (also not shown)within accessory 202 to perform an authentication procedure, e.g., basedon public key cryptography and a store of digital certificatesmaintained within the authentication manager of mobile computing device200.

The general lingo or another lingo of the accessory communicationprotocol can also include “tunnel” commands that allow an exchange ofarbitrary information between an application 226 executing on mobilecomputing device 200 and accessory 202. For example, a TunnelToAcccommand can be defined as being sendable by mobile computing device 200to accessory 202. The payload of this command can be any data, controlsignals, or other information that an application 226 executing onmobile computing device 200 can generate and send to accessory 202.Similarly, a TunnelToHost command can be defined as being sendable byaccessory 202 to mobile computing device 200. The payload of thiscommand can be any data, control signals, or other information thataccessory 202 can generate and send to an application 226 executing onmobile computing device 200. These tunnel commands can be defined suchthat the accessory communication protocol is agnostic as to the payloadcontent. Examples of techniques for managing communication such that aparticular application sends data, control signals or other informationonly to accessories capable of processing it (and vice versa) aredescribed below.

In some embodiments, the accessory can communicate with an APIassociated with one or more applications at the mobile computing deviceusing the application communication protocol. For example, suchcommunication can use the “tunnel” command discussed above. In someembodiments, the accessory can communicate with an API associated withone or more application using the accessory communication protocol. Inother embodiments, the accessory can also communicate with the mobilecomputing device operating system using either or both of the accessorycommunication protocol and/or the application communication protocol.Thus, embodiments disclosed herein can be used to facilitatecommunication from an accessory to an application, API, and/or anoperating system at the mobile computing device using either or both ofan application communication protocol and/or an accessory communicationprotocol.

An accessory communication protocol supported by a mobile computingdevice and an accessory can include various other lingoes, such as asimple remote lingo that allows the accessory to send a commandindicating a function of the mobile computing device to be invoked, aremote user interface lingo that can be used to communicate commands anddata related to replicating all or part of a user interface of themobile computing device on the accessory (thereby supporting a moreadvanced remote control), a tuner lingo that allows a user to control atuner accessory by operating the mobile computing device, a storagelingo that allows the accessory to store data on the mobile computingdevice, and so on. Any lingo or combination of lingoes or other commandsor groups of commands can be used in connection with embodimentsdescribed herein.

It will be appreciated that the accessory communication protocoldescribed herein is illustrative and that variations and modificationsare possible. Specific commands described herein can be replaced withother commands or combination of commands or other types of messages andformats. In addition, it is not required that all of the commands andoperations described herein be supported by any particular mobilecommunication device or accessory.

As noted above, application 226 executing on mobile computing device 200and accessory 202 can exchange arbitrary data, control signals, and/orother information (also referred to herein as “messages”). Thesemessages can relate to a wide variety of circumstances. For example,messages relating to user input events, detected external conditions,received data or any other events or conditions that may occur at mobilecomputing device 200 can be communicated to accessory 202. Conversely,messages relating to user input events, detected external conditions,received data or other events or conditions that may occur at accessory202 can be communicated to mobile computing device 200.

For example, in some embodiments, mobile computing device 200 canprocess input events from a user, for example, through user interface255, such as touch screen events, button presses, scroll wheel events,etc. Mobile computing device 200 can provide data representative ofinput events to an application running on mobile computing device 200,to accessory 202, or to both. Accessory 202 can interpret such data asinput for controlling, for example, accessory specific hardware 275and/or for processing at controller 260. For example, touch screen datacan be collected by mobile computing device 200 for use by anapplication, accessory 202, or both; in some embodiments, touch screendata can include data representing taps and/or movements such as swipes,pinches, drags, and other gestures. In some embodiments, touch screendata can be sent in raw data format (e.g., a sequence of coordinatesrepresenting where pressure corresponding to a finger movement wasdetected). In other embodiments, touch screen data can be converted intoprocessed data, such as gesture events (e.g., a tap, a swipe or dragfrom one point to another, a pinch, etc.) prior to being sent to anaccessory. In some embodiments, raw keyboard data can be sent to anaccessory and/or processed keyboard data can be sent to an accessory. Insome embodiments, some or all types of user input data can becommunicated to accessory 202 using an application and applicationprotocol, e.g., as described below; in other embodiments, some or alltypes of user input data can be communicated using the accessorycommunication protocol to whatever extent the accessory communicationprotocol supports sending user input data of a particular type.

Mobile computing device 200 can also send information other than userinput to accessory 202. For example, in some embodiments mobilecomputing device 200 can include various sensors and/or data gatheringdevices in addition to user input devices; examples can includeaccelerometers, gyroscopes, compass, location-determining devices (e.g.,a Global Positioning System receiver or telephonic triangulationsystem), light sensors, infrared sensors, camera, network interfaces(e.g., telephone, WiFi, Bluetooth), or the like. Mobile computing device200 can provide any or all of this data to accessory 202, e.g., inresponse to a specific request from accessory 202. In some embodiments,some or all of this data can be communicated to accessory 202 using anapplication and application protocol, e.g., as described below; in otherembodiments, some or all of this data can be communicated using theaccessory communication protocol to whatever extent the accessorycommunication protocol supports sending information of a particulartype.

In another example accessory 202 can receive input events from mobilecomputing device 200. Such events can correspond to user input and/orother data detected at mobile computing device 200, including but notlimited to any of the data types described above. In some embodiments,such input events can be processed by controller 260 at accessory 202 tocontrol accessory specific hardware 275. For example, touch screen orother user input events at mobile computing device 200 can be sent toaccessory 202 to turn on, change the state of, receive data from,provide data to, turn off, and/or set settings for, accessory specifichardware 275. Touch screen data, for example, can be sent in raw dataformat or as interpreted events (e.g., press, swipe, pinch). In someembodiments, accessory specific software 280 can include instructions toreceive and/or interpret raw touch screen data. In some embodiments,accessory specific software 280 can include instructions to translateraw touch screen data into commands and/or controls for accessoryspecific hardware 275. In another embodiment, the touch screen data canbe provided in raw format to an application executing on mobilecomputing device 200, which can interpret the data and sendcorresponding commands and/or information to accessory 202.

Moreover, input events received at accessory 202 from mobile computingdevice 200 can be processed by controller 260 executing accessoryspecific software 280. In some embodiments, accessory specific software280 can interact with accessory specific hardware 275 in response toinput events received from mobile computing device 200.

Further, in some embodiments, accessory specific hardware 275 can alsobe controlled by mobile computing device 200 via a connection withaccessory 202. For example, an application executing on mobile computingdevice 200 can include program code that when executed by processor 230,can control, interface with, interoperate with, and/or receive signalsfrom the accessory specific hardware 275 at accessory 202. In someembodiments, the application executing on mobile computing device 200can exchange messages with a control program executing on controller 260of accessory 202, thereby instructing controller 260 to communicate withand/or control operation of accessory specific hardware 275. Suchmessages can be exchanged using an application protocol, e.g., asdescribed below.

In some embodiments, accessory specific hardware 275 can provide inputdata to controller 260. For example, accessory specific hardware 275 caninclude a measurement sensor that can convert physical characteristicsinto data (or electronic signals representing data; the terms are usedinterchangeably) that can be sent to controller 260 and/or stored inmemory 265. Controller 260 can process the data (e.g., applyingcalibration corrections, reducing noise, and/or other data-processingoperations). The processed data can be sent from accessory 202 to mobilecomputing device 200. At mobile computing device 200 an application canfurther process the data and/or provide the data to a user through theuser interface. Moreover, the application can perform any number offunctions in response to the data.

In some embodiments, an accessory and an application can exchange anymessages desired, where the term “message” refers generally to any typeof control signal, event, data, status or configuration information orany other type of information available to the sender. To facilitateexchange of messages, an accessory and an application can use a mutuallyagreed-upon application protocol. The application protocol can specify auniverse of accepted formats for messages that can be exchanged. Devicesor programs adhering to a particular application protocol can structurethe messages they send in accordance with the application protocol'suniverse of accepted formats and can interpret messages they receive inaccordance with the application protocol's universe of accepted formats.For instance, in the case of binary digital communication, theapplication protocol can specify how the bits comprising the message areto be interpreted by the recipient. Thus, like the accessorycommunication protocol, an application protocol can specify packetstructures; commands; lingoes; payload formats; and/or other formats,data structures, semantics or rules of interpretation such that aparticular message sent by one participant will be correctly interpretedby the recipient. Indeed, in some embodiments, portions of the accessorycommunication protocol can be directly adopted as all or part of anapplication protocol for a particular accessory and/or application.

In certain embodiments described herein, accessory protocol messages canbe sent between devices by encapsulating, wrapping, or packaging themessages within packets conforming to the accessory communicationprotocol, e.g., using tunneling commands as described above. Thus, thetransport link specified by the accessory communication protocol can beused, and it is not necessary for an application protocol to specify aphysical transport link.

It is contemplated that an unlimited range of accessories andapplications that use a variety of different application protocols canbe created for use with a particular mobile computing device (or line ofmobile computing devices). In some embodiments, mobile computing device200 can be configured with application protocol management capability(e.g., using an application manager) that includes tracking theapplication protocol(s) used by each connected accessory and theapplication protocol(s) used by each executing and/or installedapplication. For example, mobile computing device 200 can provide systemservices to facilitate identifying an appropriate application to be usedwith a particular accessory and/or identifying whether a suitableaccessory is available for a particular application. These services canbe provided without requiring the system services of mobile computingdevice 200 to implement or communicate according to any applicationprotocol.

FIG. 3 is a block diagram showing various modules and processes withinmobile computing device 200 according to an embodiment of the presentinvention. The various modules shown can correspond to programsexecuting on processor 230 of FIG. 2, programs executing on otherprocessors within mobile computing device 200, application-specificintegrated circuits, or other implementations. In some embodiments,multiple processor chips or multiple processor cores within a singlechip can be used to implement the various modules and processesdescribed herein. Some or all of the processors can be programmablegeneral-purpose processors executing software and/or firmware programs;others can be digital signal processors, state machines with built-infunctionality, or any combination thereof.

Ports 305-307 provide communication channels for accessories 300-302respectively. Each of ports 305-307 can be a physical and/or logicalport supporting a specific communication channel. For example, port 305can be a physical port associated with a wired channel such as USB orUART and can incorporate hardware elements (e.g., USB-compatible drivercircuits and/or pins) along with suitable control software. Port 306 canbe a logical port (e.g., a virtual serial port) associated with awireless channel such as Bluetooth. In some embodiments, each port305-307 can send and receive messages conforming to the accessorycommunication protocol as applied to the particular physical transportor channel associated with that port. While three ports are shown, it isunderstood that a mobile computing device can be designed to support anynumber of physical and/or logical ports in any combination. Further, asdescribed below, a single accessory can connect to multiple ports insome embodiments.

Protocol manager 310, which can be, e.g., a firmware or software moduleexecuted by processor 230, can receive mobile computing device-protocolmessages (also referred to as commands) from ports 305-307 and begin theprocess of interpreting the messages. In some embodiments, protocolmanager 310 or an associated protocol daemon (not shown) associated withprotocol manager 310 can also create or define ports 305-307 and connectthem to suitable communication hardware, such as connector pins anddriver circuits, wireless transceivers, etc. In one embodiment, protocolmanager 310 (or its associated protocol daemon) can extract inboundmobile computing device-protocol messages received on the various portsand deliver the extracted messages to support layer 315 or to othercomponents within mobile computing device 200. Thus the upper levels ofthe process stack of FIG. 3 can be independent of a particular transportlink.

In another embodiment, protocol manager 310 can receive outboundinformation (e.g., a message that has been structured according to anapplication protocol by application 404 that created the message)intended for a connected accessory (e.g., any of accessories 300-302)from support layer 315, package the outbound message into a mobilecomputing device-protocol packet, and deliver the packet to the one ofports 305-307 that is connected to the desired accessory.

In some embodiments, protocol manager 310 (or an associated protocoldaemon) can also support and/or control opening and closing of ports.For example, in the case of a virtual port, protocol manager 310 cancreate a set of virtual ports at startup and open and/or close the portsas connections are requested and/or terminated.

Protocol manager 310 can maintain a dynamic port map 325 that associatesspecific application protocols with specific ports. For example, when anaccessory such as accessory 300 establishes a connection to mobilecomputing device 200 on a particular port such as port 305, accessory300 can identify the application protocol(s) it supports (e.g., AP3 inthe case of accessory 300) to protocol manager 310, e.g., by providing aprotocol name string via port 305. Protocol manager 310 can store anassociation between the application protocol name and the port in portmap 325. When the accessory is subsequently disconnected, theassociation can be removed from port map 325. Thus, port map 325 canprovide a list of application protocols that are currently available foruse by applications. As described below, such a list facilitates routingof communications between accessories and applications, as well asnotifying compatible applications when compatible accessories areconnected.

Software support layer 315 can act as an intermediary between protocolmanager 310 (and optionally other low-level device functions) andapplications 320-322 that can be executed on mobile computing device200. For example, software support layer 315 can provide an applicationprogram interface (API) via which applications can invoke devicefunctionality. Software support layer 315 can provide an extra level ofdevice independence to applications 320-322; however, those skilled inthe art will appreciate that not all layers shown in FIG. 3 arerequired. For instance, in some embodiments, protocol manager 310 cancommunicate directly with applications 320-322.

In the embodiment shown, support layer 315 can provide accessoryinformation lookup table 330. In one embodiment, accessory informationtable 330 can include information about each connected accessory such asaccessory type, accessory identifier, and/or the name(s) of one or moreapplication protocols supported by the accessory. Accessory informationtable 330 can be populated and updated in response to informationprovided by protocol manager 310 as accessories connect and disconnect.

Applications 320-322 can be concurrently or sequentially executingapplications and can be implemented as program code executable, e.g., byprocessor 230. Various applications 320-322 can provide various forms ofuser interaction with mobile computing device 200 and/or connectedaccessories 300-302. For example, an application can provide a userinterface to a connected measurement probe accessory. In response touser input, the application can instruct the measurement probe to beginrecording measurement data and stop recording measurement data. Theapplication can also present measurement data to a user. The applicationcan convert data into various forms and/or provide further userinteractions, such as viewing a record of measurements over time,performing analysis operations on the data (e.g., averaging, trendanalysis, graphical analysis, or the like), and so on.

An executing application (e.g., any of applications 320-322) can queryaccessory information table 330 at any time to determine whether acompatible accessory (i.e., an accessory that supports an applicationprotocol used by the application) is connected. If a compatibleaccessory is connected, the application can communicate with theaccessory using the application protocol. For example, as describedbelow, the application can initiate a communication session with theaccessory.

It will be appreciated that the modules described herein areillustrative and that variations and modifications are possible. Mobilecomputing device 200 can support any type of application, andapplications can be launched or exited under control of a user oranother process. Certain modules, such as support layer 315 and protocolmanager 310, can be implemented in software and/or firmware andconfigured to be automatically started at device power-up and toterminate only on power down or when various abnormal conditions aredetected; applications 320-322 may start and terminate in response touser input or other input. In some embodiments, an application mayautomatically be launched when a corresponding accessory is connected,e.g., as described below. The various modules or processes may go intoinactive states to minimize resource consumption when not in use.Further, not all of the layers and modules shown herein are required;for instance, in some embodiments, applications might communicatedirectly with the protocol manager, bypassing support layer 315. Inother embodiments, modules or layers shown as separate in FIG. 3 can becombined, or additional modules or layers can be provided, such as theprotocol daemon and/or modules associated with various system servicesof mobile computing device 200 (e.g., audio and/or video playback,network connections, and the like).

It is also to be understood that an accessory can implement modules,layers, and other components similar to those shown in FIG. 3, or anyvariation or modification thereof. As long as the accessory is capableof exchanging information with a mobile computing device according to anaccessory communication protocol, the internal implementation can bevaried as desired.

As shown in FIG. 3, mobile computing device 200 in some embodiments canmaintain multiple concurrently executing applications 320-322 and/orconcurrent connections to multiple accessories 305-307. The applicationsand/or accessories can support different (and potentially incompatible)application protocols, and each application protocol can be assigned aname (e.g., a unique string) to distinguish it from all otherapplication protocols. For example, in the embodiment of FIG. 3,application 320 and accessory 301 support application protocol AP1;application 321 and accessory 302 support application protocol AP2; andapplication 322 and accessory 300 support application protocol AP3.

It is contemplated that third parties will be able to independentlydevelop applications and/or accessories. If two accessories (orapplications) associate the same accessory protocol name withapplication protocols that are in fact not compatible, this can create aname conflict, e.g., if both accessories attempt to connect to the samemobile computing device concurrently. To avoid such conflicts, it may bedesirable to provide centralized namespace management for applicationprotocol names. In some embodiments, a central namespace manager (e.g.,the manufacturer of the mobile computing device) can assign names toapplication protocols upon request from developers thereof. In anotherembodiment, the central namespace manager can simply define a namingconvention that, if adhered to, should prevent name conflicts, anddevelopers of accessories and/or applications can avoid conflicts byadhering to the convention.

In one embodiment, a reverse domain name convention is adopted formanaging the application protocol namespace. Conventional domain namesprovide, from left to right, lower level domains to top level domains.For example, in the domain name: “help.example.com”, the term “com” isthe top level domain and the term “example” is a lower level domain, andthe term “help” is the lowest level domain. As another example, thedomain name “mac.apple.com” from left to right specifies the lowestlevel domain “mac”, the middle domain “apple”, and the top level domain“com”. Reverse domain names, on the other hand, would provide“com.apple.mac”.

The reverse domain name convention can be used to specify applicationprotocols used by a specific company. That is, the reverse domain name“com.company1.accessory1” specifies that the “accessory1” protocol isassociated with the company (or other developer) “company1”. Thus, ingeneral, a company can implement a protocol using the reverse domainname convention, where the first portion of the reverse domain namereferences the company (“com.company1”) and is associated with thecompany's (or other developer's) Internet domain name. The secondportion of the reverse domain name (“accessory1”) specifies a specificprotocol. To the extent that the different developers of accessoriesand/or applications are associated with different Internet domain names,a reverse domain name convention allows developers to distinguishapplications and/or protocols and/or accessories from others by namingtheir protocols based on the reverse of their Internet domain name. Thisconvention allows developers to independently name their protocolswithout concern for the naming conventions of other developers.Moreover, if there is a conflict between two developers using the samenames, a simple check of who owns the corresponding Internet domain nameshould determine which developer has rights to a particular reversedomain name.

In some embodiments, reverse domain names can be appended to include aglobal identifier that is specific to all devices in a class of devices.For instance, all serial pass through type devices can include anidentifier appended to the reverse domain name. For example, such areverse domain name may have the following format:“com.company1.accessory1.serialpass” or“serialpass.com.company1.accessory1.” With such a convention, differentcompanies can produce serial pass through devices and yet the mobilecomputing device can recognize such devices despite manufacturerdifferences. This reverse domain name convention is only one example ofhow application protocols can be identified. Any type of convention canbe used.

Accordingly, when an accessory is connected with a mobile computingdevice, the accessory can provide the mobile computing device with alist of its supported application protocols by supplying the name thatwas assigned to each supported protocol using the reverse domain nameconvention. An accessory can support a single application protocol ormultiple application protocols. Based on the received information,mobile computing device 200 of FIG. 3 can populate port map 325,accessory information table 330 and/or other lookup tables withinformation such as accessory type, accessory identifier, applicationprotocol name, and/or communication port identifier. As described below,applications 320-322 can use these lookup tables to determine whether acompatible accessory is available, and support layer 315 and/or protocolmanager 310 can use the lookup tables to route communications withouthaving to understand any of the application protocols.

For example, mobile computing device 200 can be wirelessly connectedwith a thermometer and also connected with a camera using a cable. (Forinstance, in FIG. 3, accessory 302 can be a thermometer and port Z awireless port while accessory 300 can be a camera and port X a wiredport.) Upon connection, the thermometer can identify its supportedapplication protocol by sending the reverse domain name“com.temprus.thermometer1”. This reverse domain name can be sent to themobile computing device using the accessory communication protocol. Atthe mobile computing device, this reverse domain name can be stored asan application protocol name in a lookup table (e.g., port map 325and/or accessory information table 330); in some embodiments, thereverse domain name can be stored in conjunction with an accessoryidentifier for the thermometer and/or the wireless port where thethermometer can be accessed. Similarly, upon connection, the camera canidentify its supported application protocol by sending the followingreverse domain name “com.camerasrus.camera1”, again using the accessorycommunication protocol. This reverse domain name can also be stored inthe lookup table (e.g., port map 325 and/or accessory information table330), e.g., in conjunction with an accessory identifier for the cameraand/or the port where the camera can be accessed.

Mobile computing device 200 can execute a temperature application (e.g.,application 321) that communicates with a thermometer using theapplication protocol “com.temprus.thermometer1” to make temperaturereadings. During execution, the temperature application can access thelookup table to see if a compatible application protocol is present,e.g., by searching for the protocol name “com.temprus.thermometer1”.When the temperature application finds “com.temprus.thermometer1”, theapplication has a match and can begin communicating with the thermometerusing the com.temprus.thermometer1 application protocol. Thecommunication is routed through the associated port, e.g., by usingtunneling commands of the accessory communication protocol. Theapplication protocol can specify commands, packet information, data,etc., that can be different from what is specified in the accessorycommunication protocol. Moreover, the company providing the applicationand/or the accessory (for example, the TempRUs company) can implementany communication protocol for communication between applications andaccessories.

FIG. 4 is a simplified diagram further illustrating communicationbetween an application and an accessory according to some embodiments ofthe invention. Mobile computing device 400 can be connected to accessory402, allowing application 404 executing on mobile computing device 400to communicate with accessory 402 using an application protocol.

In the embodiment shown in FIG. 4, application 404 has alreadydetermined that accessory 402 is a compatible accessory and has createda session 406 by invoking appropriate function calls to support layer408. Session 406 can be, e.g., a software object created by application404 using an API call to support layer 408. Session 406 can beassociated with the application 404 that created it as well as aparticular accessory and/or application protocol specified byapplication 404 when it creates the session. Session 406 can provide,among other things, an input stream and an output stream whose contentsare, respectively, received from and delivered to application 404.(Creation of a session is described below.)

To communicate a message (e.g., control signals and/or otherinformation) to accessory 402 using the application protocol,application 404 generates the message and writes it as data to an outputstream of session 406. In this embodiment, application 404 is solelyresponsible for formatting the message in accordance with theapplication protocol; other intermediary processes on mobile computingdevice 400 do not alter the data that is written to the output stream.

Session 406 detects the presence of data in the output stream and sendsa corresponding send (SND) instruction to protocol manager 410. The SNDinstruction provides the accessory and accessory protocol identifiersassociated with session 406 and a “bundle” that represents data from theoutput stream. In some embodiments, the bundle can correspond to all ofthe message data; however, depending on the length of the message andconstraints that might be imposed on packet length by the accessorycommunication protocol, a bundle may also correspond to only a portionof the message data. Conversely, in some embodiments, a single bundlemight include multiple application protocol messages.

Protocol manager 410 can use the accessory and accessory protocolidentifiers provided by session 406 along with port map 412 to select aport for transmission of the bundle. Protocol manager 410 can alsopackage the bundle within a command of the accessory communicationprotocol, e.g., a TunnelToAcc command as described above. The accessorycommunication protocol command is sent to port 414 for transmission.(While only one port is shown in FIG. 4, it is understood that mobilecomputing device 400 can have multiple ports.)

FIGS. 5A-5C illustrate an example of packaging (or wrapping) anapplication protocol message within an accessory communication protocolcommand according to some embodiments of the invention. FIG. 5A shows anexample of an accessory protocol packet 500. As shown, packet 500includes header 502 and payload 504. The accessory communicationprotocol, for example, can dictate the size of the header and whatinformation can be provided within header 502. In some embodiments,header 502 can include a command or byte code that can indicate what iscontained in the payload and/or what is to be done with data in thepayload. For example, in the embodiment shown, header 502 includes acommand code for the TunnelToAcc command. Header 502 can also includeother information, such as information specifying the size of payload504. In some embodiments, an optional tail 506 can be included at theend of packet 500; the tail can include information usable to detect orcorrect errors (e.g., a checksum) and/or other information as desired.Those skilled in the art will recognize that various packet types can beused in the accessory communication protocol.

FIG. 5B shows an example of an application protocol packet 510.Application protocol packet 510, in this example, includes a header 512(App. Header), payload 514 (App. Payload), and tail 516. Various otherpacket types, styles, configurations, payloads, information regions,etc., can be used in an application protocol packet. Indeed,applications and/or accessories can use application protocol packet ofany type, size, configuration, etc., as designed, developed and/orcreated by application developers without limitation; in someembodiments, some or all application protocol packets may be modeled on(or even indistinguishable by content from) accessory communicationprotocol packets. In some embodiments, an application protocol packetmay or may not include a header. In some embodiments, applicationprotocol packet may or may not include a tail. In some embodiments, anapplication protocol packet can include a payload 514 with a fixed orvariable size. In some embodiments, commands, data, and/or other messageelements can be provided within the payload and/or the header. Thespecific characteristics of the commands and/or data and/or othermessage elements can be specified by the application protocol. Further,application protocols are not required to use a packet structure formessages at all; accessory protocol messages can have any format and/orstructure that is capable of being correctly interpreted by therecipient.

FIG. 5C shows an example an application protocol packet 510 packaged (orwrapped) within payload 504 of accessory protocol packet 520. As shown,packet 520 can include accessory protocol packet header 502 followed byapplication protocol packet 510. In some embodiments, header 502 caninclude a command or byte code indicating that the payload is anapplication protocol packet. The application protocol packet, in thisexample, includes an application protocol packet header 512, applicationprotocol packet payload 514, and application protocol packet tail 516.Application protocol packet 510 may or may not completely fill payload504 of accessory protocol packet 520. More generally, an accessoryprotocol packet for a TunnelToAcc command can include any data bundleintended for delivery to the accessory and is not limited to carrying asingle accessory protocol packet.

Referring again to FIG. 4, accessory 402 receives the accessory protocolTunnelToAcc command packet, e.g., at port 422. Port 422 can route theTunnelToAcc command packet to a protocol interpreter 424, which can be,e.g., a software process executing on a controller or other processor ofaccessory 402. Protocol interpreter 424 can read the TunnelToAcccommand, extract the bundle contained therein, and forward the bundle toanother process 426 executing on a controller or other processor ofaccessory 402. Process 426 can include any process that is capable ofprocessing received information conforming to the application protocol.For instance, process 426 can include a process that extractsinstructions from the received information and generates correspondingcontrol signals for accessory-specific hardware (e.g., accessoryspecific hardware 275 of FIG. 2).

Communication from accessory 402 to mobile computing device 400 is alsosupported. For example, process 426 can generate a data bundlecorresponding to a message in the application protocol and provide thebundle to protocol interpreter 424 to be sent to mobile computing device400. Protocol interpreter 424 can package the bundle inside aTunnelToHost command of the accessory communication protocol (e.g.,similarly to the example shown in FIGS. 5A-5C) and send the command toport 422 for transmission to mobile computing device 400.

At mobile computing device 400, port 414 receives the TunnelToHostcommand packet and forwards it to protocol manager 410. Protocol manager410 recognizes the TunnelToHost command and in response thereto,extracts the bundle and forwards it to support layer 408, along withidentification of the accessory and application protocol associated withthe bundle. In some embodiments, protocol manager 410 can determinethese identifiers based on which port delivered the TunnelToHostcommand; thus, the TunnelToHost command need not provide identificationof the accessory or application protocol.

Support layer 408 uses the accessory and accessory protocol identifiersto direct the bundle to the input stream of session 406. Application 404can then read the incoming data from the input stream of session 406,interpret the data according to the application protocol and respondaccordingly.

Thus, for example, application 404 can be a thermometer application, andaccessory 402 can include a thermometer. Application 404 can request atemperature measurement from accessory 402 using an appropriateapplication protocol (e.g., a protocol named“com.temprus.thermometer1”). The application protocol, for example, canspecify a Get_Temp command that is sent by the application to requesttemperature data from the accessory. Application 404 can create anapplication protocol packet that includes, e.g., the Get_Temp commandand any preferences or variables associated with the command (e.g.,whether to return the temperature data in Fahrenheit or Celsius).Application 404 can create a packet with the proper header and/or tailas defined by the application protocol. Application 404 can then passthis packet as an application protocol message into the output stream ofsession 406. Session 406 can direct protocol manager 410 to send anaccessory protocol-tunneling command, specifying that the applicationprotocol is “com.temprus.thermometer1.” Protocol manager 410 can packagethe Get_Temp command inside a TunnelToAcc command packet of theaccessory communication protocol and can also look up the applicationprotocol name and determine that this application protocol is associatedwith port 414. Protocol manager 410 can then route the TunnelToAcccommand packet to port 414 for deliver to accessory 402.

Accessory 402 can receive the TunnelToAcc command at port 422. Protocolinterpreter 424 can extract the Get_Temp command packet and deliver itto process 426, which in this example can be a process that controls atemperature sensor and receives data therefrom. Accordingly, process 426can obtain temperature data that is to be returned to application 404.To send the data, process 426 can, for example, generate a Send_Tempcommand packet conforming to the application protocol. This packet caninclude the requested temperature data (e.g., using the temperaturescale specified in the Get_Temp command). Process 426 can provide theSend_Temp command packet as a bundle to protocol interpreter 424, withan indication that it should be sent to mobile computing device 400.Protocol interpreter 424 can package the Send_Temp command packet withina TunnelToHost command of the accessory communication protocol, and port422 can communicate the TunnelToHost command to port 414 of mobilecomputing device 400. Port 414 can deliver the incoming TunnelToHostcommand to protocol manager 410, which can extract the bundle (in thiscase the Send_Temp command packet) and provide it to support layer 408,along with the information that the bundle is associated with the“com.temprus.thermometer1” protocol, as determined from port map 412.Support layer 408 can then direct the bundle to session 406, inparticular to the input stream of session 406. Application 404 can readthe bundle from the input stream, recognize it as a Send_Temp commandpacket conforming to the application protocol, and extract thetemperature data.

In some embodiments, an accessory can use both an application protocoland commands of the accessory communication protocol to communicate withan accessory. FIG. 6 illustrates a path for commands of the accessorycommunication protocol in the embodiment of FIG. 4. In addition tosending application protocol messages via session 406, application 404can invoke accessory-protocol commands by making appropriate API callsto support layer 406, which can instruct protocol manager 410 to send anaccessory protocol command (represented here as “mobile computingdeviceProtCmdOut”) via port 414 to accessory 402. Similarly, anaccessory-protocol command received from accessory 402 (represented hereas “mobile computing deviceProtCmdIn”) can be received and processed byprotocol manager 410, and protocol manager can communicate the commandto support layer 406. Support layer 406, in turn, can act accordinglyupon application 404.

In some embodiments, an application protocol can incorporate lingoesand/or commands specified by the accessory communication protocol. Forexample, the accessory communication protocol can define a tuner lingo,RFTuner, that allows a user to control a radio frequency tuner accessorythrough the mobile computing device. For instance, the RFTuner lingo caninclude commands to turn the receiver on and off, to change the station,etc. In some embodiments, a radio tuner application can execute at themobile computing device, and the radio tuner application executing atthe mobile computing device and the radio tuner accessory can support aradio tuner application protocol that allows the radio tuner accessoryto communicate with the radio tuner application. Some or all commands ofthe RFTuner lingo can be used with the radio tuner application protocol,and the radio tuner application protocol can include other commands aswell (e.g., commands to control a preset list of stations that the userlikes). Thus, the radio tuner application can use the RFTuner lingo aspart of the radio tuner application protocol to communicate with theradio tuner accessory, e.g., for changing the station, and can also useother commands of the radio tuner application protocol for otheroperations. The mobile computing device can also use the RFTuner lingoas part of the accessory communication protocol to communicate with theradio tuner accessory independent of the application. Thus, the radiotuner accessory can send commands and/or messages to the mobilecomputing device using a single lingo within either of the twoprotocols.

As another example, the RFTuner lingo can include an RFSetFreq commandthat is sent from the mobile computing device (for instance, theapplication executing at the mobile computing device) to tune the radiotuner accessory to the frequency to a frequency included in the command.The radio tuner application can create a packet with the proper headerand/or tail as defined by the application protocol, and include theRFSetFreq command and the required frequency in the packet payload. Thepacket can then be sent to the Protocol manager which can bundle thepacket into an accessory protocol packet with a command of the accessorycommunication protocol, e.g., a TunnelToAcc command as described above.The accessory protocol packet can then be sent to the accessory. Asanother example, the RFSetFreq command can be used without a radio tuneraccessory and without being tunneled. The mobile computing device cansend a packet using the accessory communication protocol using theRFSetFreq command and the associated frequency to the accessory as astand alone packet.

As yet another example, an accessory can use the RFTuner lingo tocommunicate with the mobile computing device using either theapplication protocol and/or the accessory communication protocol. Forexample, the accessory can use the TunnelToHost command to tunnelRFTuner commands to the mobile computing device when communicating witha specific application at the mobile computing device. As anotherexample, the accessory can send RFTuner commands without tunneling tothe mobile computing device.

In another embodiment, an accessory such as a speaker dock may provideremote control of media playback on the mobile computing device. Theremote control functions can be implemented using commands of theaccessory communication protocol; for example, the accessorycommunication protocol can include a ButtonStatus command that theaccessory can send to identify a particular function invoked by the user(e.g., Play, Pause, Next Track, Previous Track, etc.). The mobilecomputing device can have a playback engine for stored media that canprocess the ButtonStatus command and respond accordingly. An applicationexecuting on the mobile computing device can provide playback of othermedia sources, e.g., from an Internet data stream. It would be desirablefor the user to be able to remotely control the playback of thestreaming content by operating the accessory in the same way that theuser controls the playback of stored media. Accordingly, a “streamingcontrol” application protocol can be defined that includes commands orother control signals to control the playback of streamed content. Theuser can operate the accessory in exactly the same way to controlplayback of either stored or streamed media content. If stored contentis being played, the accessory can communicate the remote controlinformation to the playback engine using the accessory communicationprotocol (e.g., the ButtonStatus command). If streamed content is beingplayed, the accessory can communicate the remote control information tothe application using the streaming control application protocol. In oneembodiment, the ButtonStatus command of the accessory communicationprotocol can be incorporated into the streaming control applicationprotocol.

In still another embodiment, an accessory might send locationinformation to the mobile computing device. Location information caninclude any information representing the location of the accessoryand/or the mobile computing device and can be determined in variousways, such as using a Global Positioning System (GPS) receiver and/ortriangulating a location based on information about nearby mobile phonenetwork access points. The accessory communication protocol may providea “location” lingo that is usable by an accessory to transmit locationinformation to the mobile computing device. An application, however,might use location information that is not provided for in the locationlingo. Such information can be transmitted by the accessory to theapplication using an accessory-specific protocol. Thus, depending on howthe location information is to be used, the same accessory can transmitlocation information to the mobile computing device using either thelocation lingo of the accessory communication protocol or theaccessory-specific protocol.

It will be appreciated that the communication paths described herein areillustrative and that variations and modifications are possible. Forexample, a path may include more or fewer layers at the accessory and/ormobile computing device side. In some embodiments, each mobile computingdevice tunneling packet will contain one accessory protocol message, butthis is not required. For example, a single accessory protocol messagemight be sent using multiple mobile computing device tunneling packets,provided that the recipient (the accessory or application as the casemay be) is capable of reconstructing a message from multiple receiveddata bundles. Similarly, a single mobile computing device tunnelingpacket might be allowed to contain multiple accessory protocol messages,provided that the recipient is capable of parsing the bundle intomultiple messages.

In describing FIG. 4, it was assumed that application 404 had alreadyestablished session 406 with compatible accessory 402. Examples oftechniques enabling an application to identify a compatible accessory(or vice versa) and establish a session will now be described.

FIG. 7 is a flow diagram of process 700 for identifying an accessory andcompatible application according to an embodiment of the presentinvention. Process 700 can start at block 702. The mobile computingdevice can determine whether an accessory has been connected at block704. For example, the mobile computing device can detect whether anaccessory has been physically coupled with a connector, e.g., as shownin FIG. 1A or whether an accessory has been wirelessly coupled with themobile computing device, e.g., as shown in FIG. 1B. As noted above, anaccessory can be considered as being connected whenever a wired orwireless communication channel between the mobile computing device andthe accessory is open, and block 704 can include detecting the openingof such a channel. An application manager executing at the mobilecomputing device can monitor hardware connections or communicationmodules to determine if a communication channel between the mobilecomputing device and the accessory is open.

At block 706, the mobile computing device can receive applicationprotocol information from the accessory. In some embodiments, thisinformation can be communicated using packets defined by the accessorycommunication protocol. In other embodiments, the application protocolinformation can be communicated in any manner understood by either orboth the accessory and the mobile computing device. For instance, theapplication protocol information can be communicated using any industrystandard communication protocol such a USB protocol, Bluetooth protocol,or WiFi protocol. For example, the accessory communication protocol canspecify one or more commands and associated data formats that anaccessory can send to a mobile computing device to provide informationabout itself and its capabilities; in some embodiments, these commandscan be part of the general lingo of the accessory communicationprotocol. The information provided by the accessory can include textstrings for the name(s) of the application communication protocol(s)supported by the accessory. The names can be specified, for instance,using the reverse domain name convention as described above or any otherdesired naming convention. The accessory can also send other identifyinginformation. For example, the accessory can send information identifyingits type; manufacturer; model name; serial number; hardware, softwareand/or firmware versions; etc. The accessory can also send informationindicating capabilities of the mobile computing device that it iscapable of or intending to use. For example, the accessory can specifywhich lingo of the accessory communication protocol it may use, whetherit receives or provides audio and/or video signals from or to the mobilecomputing device, preferred initial operating states of the mobilecomputing device (e.g., whether audio and/or video signal exchangeshould initially be enabled or disabled, a preferred format for audioand/or video signaling), and so on.

In other embodiments, the application protocol can be specified byreferencing an application store or from a server over the Internet. Forexample, when an accessory is coupled with the mobile computing device,the mobile computing device can request application protocol informationfrom the application store and/or from a server through the Internet. Inone embodiment, the mobile computing device can sendaccessory-identifying information such as accessory manufacturer, modelname, and/or serial number to the application store or other server andreceive application protocol information in response. Applicationprotocol information sent from the accessory, for example, can includethe application protocol name; a file specifying various applicationprotocol commands, messages and/or packet specifications; a listing ofaccessories with which the application protocol is compatible; a listingof applications with which the application protocol is compatible; anindication of a network location where an application or applicationupdate can be downloaded; etc. The application protocol information canbe sent in a metadata format. In some embodiments, various versions ofthe application protocol can be made available through the applicationstore or through the Internet. For example, different versions of anapplication protocol can allow various levels of functionality and canbe provided for use with a mobile computing device at different prices.For example, “lite” versions, free versions, full versions, demoversions, etc. can be made available. For example, a full version candefine a set of commands usable by the mobile computing device and/oraccessory, whereas a lite version defines a subset of the commandsdefined by the full version.

In some embodiments, application protocols can be enumerated whencommunicated to the mobile computing device. The accessory can identifyeach supported application protocol with an index number or some type ofindication that relates to each application. For example, the accessorycan send a message that indicates that index 1 is application protocol1, index 2 is application protocol 2, and index 3 is applicationprotocol 3. Each application protocol can be indicated using any typeindication such as, for example, using the reverse domain nameconvention. Later these protocols can be referenced using their indexnumber. Such enumeration can be used in embodiments described throughoutthis disclosure.

The mobile computing device can authenticate the accessory usingauthentication procedures in accordance with the accessory communicationprotocol at block 708. These procedures can include, for example,authentication techniques based on public-key certificates stored in themobile computing device and private keys held by various accessoriesand/or other techniques. In some embodiments, the mobile computingdevice can authenticate every accessory upon connection andidentification (e.g., after block 706). In other embodiments, the mobilecomputing device can authenticate every accessory prior to or duringidentification at block 706, and in still other embodiments,authentication can occur later in the process or not at all. Forexample, in some embodiments, the mobile computing device permitscertain features and/or operations associated with the accessorycommunication protocol to be accessed only by authenticated accessories;such “restricted-access” features can include features related tocommunication of accessory protocol commands (e.g., the tunnelingcommands described above can be restricted-access commands). The mobilecomputing device can wait to authenticate an accessory until theaccessory attempts to use a restricted-access feature, or the mobilecomputing device can authenticate the accessory at any time afterreceiving information indicating that the accessory will or mightattempt to use a restricted-access feature.

The mobile computing device can then create and/or update a “connected”application protocol list at block 710 using the application protocolinformation supplied at block 706. For example, referring to FIG. 3,port map 325 and/or accessory information table 330 can be updated toassociate the newly connected accessory and its application protocol(s)with a port. Any of the accessory identifying information provided atblock 706 can be stored in a connected application protocol list by themobile computing device. One example of a connected protocol list isshown in FIG. 8 as table 820. Table 820 lists each application protocolthat a currently-connected accessory has identified in association withthe port to which the accessory is connected. (Accordingly, table 820can be an example of port map 325 of FIG. 3). It is understood that theformat and information content of table 820 can be varied as desired.

Referring again to FIG. 7, at block 712, the mobile computing device candetermine whether any applications are available that use theapplication protocol(s) associated with the accessory (such applicationsare also referred to herein as “compatible” applications). For example,the mobile computing device can store a table of supported applicationprotocols, with each protocol being associated with the application (orapplications) that supports it. One example of a supported-applicationprotocol table is shown in FIG. 8 as table 810. Table 810 includes alist of application protocol names, and each application protocol nameis associated with an identifier of one or more applications. In someembodiments, table 810 can be implemented as a lookup table that can beaccessed using the name of an application protocol to return anapplication identifier; table 810 can also be accessible using anapplication identifier to return a list of application protocolsassociated with a particular application.

In some embodiments, table 810 includes only application protocolsassociated with currently executing applications. For example, when anapplication launches, it can provide a system process of the mobilecomputing device (e.g., support layer 315 of FIG. 3) with a list of anyapplication protocols that it requires and/or can use. The mobilecomputing device system process can update table 810 accordingly. Inother embodiments, table 810 can be a persistent table that ismaintained for all applications installed on the mobile computingdevice. For example, installing (or updating) an application can includenotifying a system process of the mobile computing device (e.g., supportlayer 315) of any application protocols that the application requiresand/or is capable of using; the mobile computing device can update table810 accordingly.

In some embodiments, when an accessory is coupled with the mobilecomputing device, the accessory can identify itself by sendingidentification information, for example, using an accessoryidentification lingo associated with the accessory communicationprotocol. The identification information can be used by the mobilecomputing device to select an appropriate application communicationprotocol, for example, by referencing table 810. In some embodiments,the mobile computing device can send accessory identifying informationto an application store and/or a server through the Internet to identifyan application communication protocol compatible with the accessory. Insome embodiments, the application store and/or server can send a filedetailing an application communication protocol compatible with theaccessory. In some embodiments, the accessory may not send applicationprotocol information to the mobile computing device, rather theaccessory can send accessory identification information that is thenused by the mobile computing device to chose the proper applicationcommunication protocol.

Referring again to block 712 of FIG. 7, in embodiments where a supportedapplication protocol table (e.g., table 810 of FIG. 8) is provided, themobile computing device can determine whether a compatible applicationis available by accessing the supported protocol table using theprotocol name of the newly connected accessory. For example, as shown inFIG. 8, if the newly connected accessory has provided protocolString{c}as its application protocol identifier, block 712 of process 700 caninclude looking up protocolString{c} in supported protocol table 810 andthereby determining that an application “App8” is associated with thisapplication protocol. In this case, block 712 would result in adetermination that an application is available. As further shown in FIG.8, if the newly connected accessory has provided protocolString{x} asits application protocol, no match can be found in table 810, and block712 of process 700 would result in a determination that a compatibleapplication is not available.

If a compatible application is not available, process 700 can facilitatelocating and obtaining a compatible application at block 714. Forexample, the mobile computing device can direct the user to anapplication store (e.g., the iTunes® Store provided by Apple Inc.) orother resource for purchasing and/or downloading applications. Varioustypes of assistance can be provided. For instance, in some embodiments,the accessory information provided to the mobile computing device atblock 706 can include an identifier of a preferred application for usewith the accessory. This identifier might be a URL (uniform resourcelocator, e.g., a World Wide Web page address), a unique productidentifier for the preferred application in a particular applicationstore, or the like. The mobile computing device can use this informationto locate the preferred application and prompt the user to purchaseand/or download the application.

In other embodiments, the mobile computing device can use theapplication protocol information, with or without other accessoryidentifying information, to search for a compatible application, e.g.,within an application store. For example, as shown in FIG. 9, the mobilecomputing device can formulate a query 825 using one or more of theconnected application protocols and/or an identifier for a preferredapplication provided by the accessory (represented as appCode 830). Themobile computing device can send query 825 to a URL 840 associated withsearching at an application store or another destination. In the exampleshown, the query includes a list of all connected application protocols(linked with a logical “OR” operand), along with appCode 830 for thepreferred application. In the event that multiple applications match thequery, preferred application 830 can be used by the application store tohighlight the preferred application (assuming it is on the list ofmatches). Thus, even though a number of applications may be listed thatsupport one or more of the application protocols in connected protocollist 820, preferred application 830 may be the default application andmay be listed as such, e.g., at the top of a results list and/or markedwith an symbol, word, or logo identifying it as preferred. In someembodiments more than one version of the preferred application may beprovided with a ranking, so that the user may be presented with a tieredlist. For example, a pro version, a standard version and/or a freeversion of the preferred application can all be provided.

In response to a query, the application store can return a list of oneor more compatible applications, and the mobile computing device canprompt the user to select a compatible application to download. In someembodiments, applications can be installed immediately upon downloading;in other embodiments, the user may be separately prompted to downloadand then install the application. In yet other embodiments the user maybe required to purchase the application. In some embodiments purchasecan be made through an application store, using credit, and/or through apreviously established account.

In still other embodiments, a compatible application may be pre-storedon the accessory itself, and the accessory communication protocol caninclude commands allowing the accessory to indicate that it has acompatible application stored thereon; in response to such anindication, the mobile computing device can upload the compatibleapplication from the accessory and install it. (In some embodiments, themobile computing device may prompt the user for approval prior touploading and/or installing accessory-provided applications.)

Referring again to FIG. 7, at block 716 it is determined whether acompatible application is now available and installed. (For instance, acompatible application might not have been located or the user mighthave chosen not to purchase or download it.) If not, process 700 can endat block 718.

If, at block 716, a compatible application is available (eitherpreviously installed or just installed via block 714), then at block720, the mobile computing device can determine whether the compatibleapplication is already running If not, the application can be launchedat block 722. Depending on implementation, block 722 can includeprompting the user to confirm that the application should be launched.

At block 724, the application can communicate with the accessory. Insome embodiments, block 724 can include creating a session and sendingand/or receiving application protocol commands via the session, e.g., asdescribed above. Block 724 can also include sending and/or receivingcommands and other information using the accessory communicationprotocol. Thus, the same application and accessory can use functionssupported by the accessory communication protocol and can also exchangeother information, control signals, data, etc. using an applicationprotocol that might or might not overlap with the functions supported bythe accessory communication protocol. Communication can persistindefinitely, e.g., until the accessory becomes disconnected from themobile computing device and/or the application exits. At that point,process 700 can end (block 718).

Process 700 can be implemented using hardware, software and/or firmwareat a mobile computing device. For example, system processes and/orapplications may execute to control the functionality of the mobilecomputing device to perform the actions described above.

In some embodiments, the mobile computing device can maintain apersistent list of all or a number of application protocols supported byany accessory that has ever connected to that mobile computing deviceeven after the accessory disconnects. When the mobile computing devicecommunicates with an application store, the mobile computing device canprovide some or all of the protocols on the persistent list to theapplication store (e.g., as a search query to a server hosting theapplication store), and the application store can suggest applicationsthat the user might be interested in based on the list. For example, theapplication store can identify other applications that use the sameapplication protocol(s). If the persistent list also includesinformation identifying particular accessories associated with eachapplication protocol, the information provided by the application storecan identify particular accessories as compatible with the identifiedapplications. This can assist the user in selecting applications topurchase and/or download.

FIG. 10 is a flow diagram of a process 1000 that can be executed by anapplication to initiate communication with an accessory according to anembodiment of the present invention. Process 1000 can start (block1002), e.g., when the application is launched on the mobile computingdevice. For example, the user can manually launch the application, orthe application can be launched automatically by the mobile computingdevice in response to an accessory connecting (e.g., as described abovewith reference to FIG. 7).

At block 1004, the application checks to determine whether a compatibleaccessory is connected. (As used herein, an accessory is “compatible”with a particular application if the accessory supports an applicationprotocol that is required and/or usable by that application.) Forexample, in embodiments where the mobile computing device maintains aconnected accessory table such as table 820 of FIG. 8, the applicationcan query the table using the name of a desired application protocol todetermine whether a compatible accessory is connected. This query caninclude, e.g., invoking an API function call to communicate with asupport layer (e.g., support layer 315 of FIG. 3).

If, at block 1006, a compatible accessory is not connected, theapplication can wait at block 1008 for a certain amount of time and thentry again. If, for example, a timeout period is reached, then process1000 ends at block 1020. In some embodiments, while waiting at block1008, the application can generate a message to the user prompting theuser to connect a compatible accessory. In some embodiments, theapplication can register with a mobile computing device system serviceand request a notification when a compatible accessory becomes availablerather than repeatedly checking. In still other embodiments, theapplication can exit if a compatible accessory is not connected and canalso notify the user that the application will not run unless acompatible accessory is connected or the application can run withreduced functionality.

If a compatible accessory is detected at block 1010, the application caninitiate a session with that accessory. For example, the accessory caninvoke an API call of support layer 408 (see FIG. 4) or an applicationmanager (see FIG. 14) to create a session that is associated with aparticular accessory and application protocol (e.g., session 406 of FIG.4). The session, represented in FIG. 10 by block 1012, can continueindefinitely. As described above, during the session the application cansend and/or receive messages (e.g., control signals, data, status and/orother information) using the application protocol associated with thesession, and the application can also send and/or receive messages usingthe accessory communication protocol to the extent that desiredfunctionality is supported within the accessory communication protocol.

A session can eventually end. For example, at block 1014, theapplication can determine that the session should be ended (e.g., inresponse to a user instruction such as exiting the application orindicating that the accessory is no longer to be used) and can terminatethe session at block 1016 in response to such a determination. Asanother example, at block 1018, the application can be notified that theaccessory has disconnected; this can also result in session terminationat block 1016. Session termination at block 1016 can include, e.g.,invoking an API call to destroy or close the session object and freeassociated resources. For example, in embodiments where only one sessionat a time is permitted for a given combination of accessory andapplication protocol, session termination can signal the mobilecomputing device that the accessory and its protocol are now free to beused in another session, e.g., with a different application. In someembodiments, terminating the session can result in disconnecting theaccessory (e.g., the mobile computing device can close the port); inother embodiments, the accessory can remain connected after the sessionterminates; and in still other embodiments, the application can instructthe mobile computing device system services as to whether to disconnectthe accessory when the session terminates.

Once the session terminates, process 1000 can end. In some embodiments,if the application is still executing after session termination process,1000 can return to block 1004 to look for a compatible accessory andstart a new session.

It will be appreciated that the accessory communication protocoldescribed herein is illustrative and that variations and modificationsare possible. Acts described as sequential may be executed in parallel,order of acts may be modified, and/or acts may be added, omitted orcombined.

In some embodiments, a mobile computing device can support concurrentconnections to multiple accessories and/or concurrent execution ofmultiple applications. Thus, a single application can be concurrentlyinteracting with multiple accessories, or a single accessory can beconcurrently interacting with multiple applications.

For example, FIG. 11 illustrates an application 1100 on mobile computingdevice 1102 concurrently interacting with accessory A 1106 and accessoryB 1108 according to some embodiments of the invention. Accessories A1106 and accessory B 1108 can be different types of accessories, or theycan be similar or even identical accessories. In this example, eachaccessory is connected on a different port; thus, accessory A 1106 isconnected to port 1110 and accessory B 1106 is connected to port 1112.Application 1100 has created two sessions 1114, 1116. Session 1112 isassociated with accessory 1104 and uses an application protocol A1,while session 1114 is associated with accessory A 1106 and uses anapplication protocol B1. Sessions 1112 and 1114 are independent of eachother; either can be initiated, used, and/or terminated withoutaffecting the other. In some embodiments, the session can be protocolspecific. Port 1110 can use the accessory communication protocol toprovide a “tunnel” for messages conforming to protocol A1 to passbetween mobile computing device 1102 and accessory 1106, and port 1112can use the (same) accessory communication protocol to provide aseparate tunnel for messages conforming to protocol B1 to pass betweenmobile computing device 1102 and accessory 1108. It is understood thatapplication protocols A1 and B1 can be different protocols or the sameprotocol as desired. Further, while two accessories and two sessions areshown, any number of accessories and sessions can be connected with aparticular application in the manner described herein, provided onlythat sufficient hardware and/or software resources (e.g., ports and/orsessions) are available on the mobile computing device.

FIG. 12 illustrates two applications, application 1 1200 and application2 1202, that are executing on mobile computing device 1204 andconcurrently interacting with accessory A 1206 and accessory B 1208according to some embodiments of the invention. Accessories A 1206 andaccessory B 1208 can be different types of accessories, or they can besimilar or even identical accessories. In this example, each accessoryis connected on a different port; thus, accessory A 1206 is connected toport 1210 and accessory B 1208 is connected to port 1212. Application 11200 has created a session 1214 associated with accessory A 1206 andapplication protocol A1, and application 2 1202 has created a session1216 associated with accessory B 1208 and application protocol B1.Sessions 1212 and 1214 are independent of each other; either can beinitiated, used, and/or terminated without affecting the other. Port1210 can use the accessory communication protocol to provide a tunnelfor messages conforming to application protocol A1 to pass betweenmobile computing device 1204 and accessory 1106, and port 1212 can usethe (same) accessory communication protocol to provide a separate tunnelfor messages conforming to application protocol B1 to pass betweenmobile computing device 1204 and accessory 1208. As with FIG. 11, it isunderstood that application protocols A1 and B1 can be differentprotocols or the same protocol as desired. Further, while twoaccessories, two applications, and two sessions are shown, any number ofaccessories, sessions, and/or applications can be concurrently supportedin the manner described herein, provided only that sufficient hardwareand/or software resources (e.g., ports and/or sessions) are available onthe mobile computing device.

FIG. 13 illustrates two applications, application 1 1300 and application2 1302, executing on mobile computing device 1304 and concurrentlyinteracting with an accessory 1306 according to some embodiments of theinvention. In this example, accessory 1306 supports two differentapplication protocols (A1 and A2). Protocols A1 and A2 can differ inname only, or they can be two distinct and potentially incompatibleprotocols. Accessory 1306 is connected to mobile computing device 1304on port 1310, which is associated with protocol A1, and is alsoconnected to mobile computing device 1304 on port 1312, which isassociated with protocol A2. Application 1 1300 has created a session1314 associated with accessory 1306 and application protocol A1 and cantherefore communicate with accessory 1306 via port 1310. Similarly,application 2 1302 has created a session 1316 associated with accessory1306 and application protocol A2 and can therefore communicate withaccessory 1306 via port 1312. Sessions 1312 and 1314 are independent ofeach other; either can be initiated, used, and/or terminated withoutaffecting the other. Port 1310 can use the accessory communicationprotocol to provide a tunnel for messages conforming to applicationprotocol A1 to pass between mobile computing device 1304 and accessory1306, and port 1312 can use the (same) accessory communication protocolto provide a separate tunnel for messages conforming to applicationprotocol A2 to pass between mobile computing device 1304 and accessory1306. While two applications, and two sessions are shown, any number ofaccessories, sessions, and/or applications can be concurrently connectedto the same accessory in the manner described herein, provided only thatsufficient hardware and/or software resources (e.g., ports and/orsessions) are available on the mobile computing device.

It will be appreciated that the system configurations of FIGS. 11-13 areillustrative and that variations and modifications are possible. Forexample, any number of applications and any number of accessories can beconnected using any number of sessions and ports. As described above,the session can be a software entity that hides the application from thedetails of the physical connections (e.g., ports and the like). Thus,the application does not need to know which port a compatible accessoryis connected to in order to communicate with it. Further, thecommunication path can also include other intermediate layers (e.g., aprotocol manager and/or protocol daemon layer as described above).

An application manager can be used to abstract a communicationconnection between an application and a communication port to make theparticulars of a communication protocol transparent to applicationprograms. In some embodiments, when a communication connection isabstracted, an application program can communicate with an accessory bywriting data to an output stream and reading data from an input streamwithout knowing any details of the accessory it is communicating with.This can occur using an application manager.

In some embodiments, an application manager can include portions of orbe implemented by the support layer 408 or protocol manager 410 shown inFIG. 4. FIG. 14 illustrates an example of such an abstraction. Thefigure shows the flow of data between application layer 1402,application manager 1404, and hardware transport layer 1406 of a mobilecomputing device according to some embodiments of the invention. Theapplication layer 1402 can be any kind of process running at the mobilecomputing device. The hardware transport layer 1402 can include any typeof hardware interface or software interface between the mobile computingdevice and the accessory.

Application manager 1404 can provide communication interface betweenaccessories through the hardware transport layer 1406 and through theapplication layer 1402. In doing so, communication can be abstractedsuch that application 1402 does not know the specifics of the accessorywith which it is communicating or the specifics of the port where theaccessory is coupled. Application manager 1404 can be a backgroundprocess that is part of the operating system of the mobile computingdevice or another background process executing at the mobile computingdevice. Application manager 1404 can provide input and output streams toan application that can be used to communicate with an accessory.

In some embodiments, application manager 1404 can manage connectedaccessories that are coupled with the mobile computing device and can beaccessed through hardware transport layer 1406. Application manager 1404can also manage accessory communication features of applicationsexecuting or installed on the mobile computing device. In both cases,application manager 1404 can store application protocol informationassociated with accessories and/or applications. FIGS. 15-18 showvarious processes that can be implemented to establish sessions andprovide communication between an application and an accessory using theapplication manager.

FIG. 15 is a flow diagram of process 1500 that can be executed by anapplication manager at a mobile computing device to establish and managea session according to some embodiments of the invention. Process 1500can start at block 1502. At block 1504, the application manager monitorsthe communication ports to determine whether an accessory has beenconnected (i.e., is in communication) with the mobile computing device.In some embodiments, the application manager can monitor the hardwarestate of a physical connector to determine if an accessory is coupledwith the mobile computing device. In some embodiments, the applicationmanager can receive an indication from a WiFi or Bluetooth moduleindicating that a wireless connection has been established. Regardlessof the type of port, the application manager can determine whether acommunication channel has been established with the accessory. At block1506 process 1500 continues to monitor whether an accessory is coupledwith the mobile computing device.

Once a communication channel has been established as determined at block1506, process 1500 can then perform authentication processes at block1508. Authentication can proceed by sending various messages between themobile computing device and the accessory using the accessory protocol.Once the accessory is authenticated and given permission to communicatewith the mobile computing device, accessory capability information canbe received at block 1510. The capability information can includeinformation indicating one or more application protocols with which theaccessory is compatible. Application protocols can be indicated using,for example, a reverse domain name convention as described above, or anyother convention to indicate the application protocol. Some or all ofthe information can be stored in memory at the mobile computing deviceat block 1512. In particular, the application protocols can be stored ina lookup table (e.g., the connected application protocol table 820 ofFIG. 8) that associates application protocols with the communicationport where the accessory is coupled.

At block 1514 the application manager can determine whether to allowcommunication between the accessory and the mobile computing device oran application executing at the mobile computing device using anapplication protocol supported by the accessory. In some embodiments,communication can be allowed if an application (or other process) isexecuting on the mobile computing device that supports an applicationprotocol supported by the accessory. For example, the applicationmanager can compare application protocols supported by applicationsexecuting at the mobile computing device with application protocolsstored in the lookup table. Communication between the accessory andapplication can occur using the application protocol. In someembodiments, an application protocol message can be tunneled or embeddedwithin an accessory protocol message (e.g., by wrapping the applicationprotocol message within an accessory protocol message). As long as theaccessory is not decoupled from the mobile computing device at block1516 and/or execution of the application is not terminated at block1518, communication can continue. Otherwise, in some embodiments,application protocols stored in the lookup table can be removed at block1520, and process 1500 can end at block 1522.

FIG. 16 is another flow diagram of a process that can be executed by anapplication manager at a mobile computing device to coordinatecommunication between an accessory and an application executing at themobile computing device according to some embodiments of the invention.Process 1600 can start at block 1605. At block 1610 application managercan receive a request for accessory information from an applicationexecuting at the mobile computing device. If an accessory is notattached at block 1615, a message can be sent to the application soindicating, and process 1600 can return to block 1610 and wait until anaccessory is coupled with the MCD or in some embodiments process 1600can end. If an accessory is connected with the mobile computing devicethen the application manager can provide the application with accessoryinformation including an indication of any application protocolssupported by each and every accessory coupled with the mobile computingdevice at block 1620. The application manager can send any or all of theapplication protocol information, including the application protocolssupported by the accessory as metadata, e.g. using the reverse domainname convention. Each application protocol can be associated with anapplication protocol identifier.

In some embodiments, rather than requesting accessory information, theapplication can send application protocol data to the applicationmanager. And the application manager can select an application protocolfrom a lookup table (e.g. the connected application protocol table 820)that is compatible with the application protocol data sent from theapplication, if one exists.

At block 1625, the application can open a communication session for anapplication protocol and can indicate the protocol to the applicationmanager; for example, using the application protocol identifier. Indoing so, the application can make the request without specifyinganything about the accessory or the port. In response to opening thecommunication session the application manager can provide an outputstream and an input stream associated with the session to theapplication at block 1630. In some embodiments, the communicationsession is opened for a particular protocol associated with a particularaccessory. So multiple sessions can be created using multiple protocolsfor communication with one or many accessories.

At block 1635, the application manager can receive an applicationprotocol message from the application using the application protocolassociated with the communication session. The application protocolmessage can be received at the application manager using the outputstream provided at block 1630. The application manager can then wrap theapplication protocol message with an accessory protocol wrapper at block1640. In some embodiments, this wrapping can include embedding theapplication protocol message within an accessory protocol message (e.g.,as shown in FIGS. 5A, 5B and 5C). In some embodiments, this wrapping cantunnel the application protocol message using the accessory protocol. Atblock 1645 the wrapped application protocol message can be sent to theaccessory. Process 1600 can then proceed to block 1650. Turning back toblock 1635, if the application manager does not receive an applicationprotocol message at block 1635 process 1600 can proceed to block 1650.

At block 1650, the application manager can receive an accessory protocolmessage from the accessory. The accessory protocol message can includean application protocol message wrapped within an accessory protocolmessage. At block 1655, the accessory protocol wrapper can be strippedfrom the application protocol message; and the application protocolmessage can be sent to the application at block 1660.

If either the accessory is disconnected from the mobile computing device1670 or the application ceases to execute at the mobile computing device1665 than process 600 can end at block 1675. Otherwise the processreturns to block 1635.

A process that can be performed at an accessory coupled with a mobilecomputing device is shown in FIG. 17. Process 1700 can start at block1702, when an accessory becomes connected with the mobile computingdevice. At block 1704 the accessory can send a message to the mobilecomputing device indicating the application protocols supported by theaccessory. This message may be part of the accessory capabilitiesdescribed in regard to block 1510 of FIG. 15. This message can be sentin accordance with the accessory protocol. The accessory can indicatethe application protocols using a reverse domain name convention (e.g.,as described above). When a communication session has been establishedby the application manager, at block 1706, the mobile computing devicecan send the accessory a message, using the accessory protocol,indicating that a communication session has been created. This message,or a subsequent message, can indicate the application protocol used tocreate the session as indicated in block 1708. In some embodiments, atblock 1708 a session ID can be communicated instead of or in addition tothe application protocol. At block 1710 an acknowledgement message canbe sent to the mobile computing device from the accessory using theaccessory protocol prior to communicating with the mobile computingdevice using the application protocol at block 1712. Process 1700 canend at block 1714. Process 1700 can end, for example, when theapplication is closed by the user or the operating system, when theapplication or operating system closes the session, and/or when theaccessory is disconnected.

FIG. 18 is a flow diagram of process 1800 that can be executed by anapplication at a mobile computing device to open a communication with anaccessory according to some embodiments of the invention. Process 1800can begin at block 1805. At block 1810 the application can requestinformation about the connected accessories from the applicationmanager. The application manager can respond by sending accessoryinformation to the application, which can be received by the applicationat block 1815. A response from the application manager can be receivedat block 1815 that includes accessory information. The accessoryinformation can include information indicating the accessories coupledwith the mobile computing device, the application protocol(s) compatiblewith the accessory, and/or identifiers associated with the applicationprotocol(s). In some embodiments, the accessory manger can direct theapplication to the memory location where a listing or table of theconnected application protocols can be located.

At block 1820 the application (or mobile computing device) can determinewhether any of the application protocols or a single applicationprotocol that is compatible with an attached accessory matches anapplication protocol compatible with the application. If a match isfound, process 1800 moves to block 1835. If there are no matches, anapplication that is compatible with an application protocol associatedwith the accessory can be searched for on the internet (e.g., at anonline application store) or on the mobile computing device at block1825. In some embodiments, the accessory information can includeinformation indicating a preferred application for use with theaccessory. In some embodiments, an application can be downloaded andexecuted at the mobile computing device at block 1830 and process 1800can move to block 1835. In some embodiments, an application add-on orpatch can be downloaded from a network location (e.g., at an onlineapplication store) that provides compatibility with an applicationprotocol that is also compatible with the accessory. If a newapplication is not downloaded and there are not compatible applicationsfound, then process 1800 can end at block 1865.

In some embodiments, at block 1820, in the event no compatibleapplications are found or available at the mobile computing device oneof three options can be performed. First, the user is prompted whetherthey'd like to search for and/or download a compatible application froma network location or application store. The process can the proceed inaccordance with the user's choice. Second, the mobile computing devicecan search for and/or download a compatible application withoutprompting the user. Third, the mobile computing device may neitherprompt the user nor search for a compatible application. In someembodiments, the accessory can send a message indicating which of theabove three options should be followed by the mobile computing device.This message can be sent prior to or at block 1810 or block 815. Inother embodiments, a system setting at the mobile computing device canbe set by the user indicating which of the above options should befollowed for all accessories.

At block 1835, the application can open a communication session that istied to a compatible application protocol. Once a session is created,the application manager can provide input and output streams to theapplication at block 1840. At block 1845, the application cancommunicate with the accessory by writing data formatted according tothe application protocol to the output stream, and by readingapplication protocol data from the input stream.

As long as the accessory is coupled with the mobile computing device, asdetermined at block 1850, and the application does not end the sessionat block 1855, the application can communicate with the accessory usingthe input/output streams provided by the application manager. Otherwise,the session can be terminated at block 1860 and process 1800 can end atblock 1855.

In some embodiments of the invention, when an accessory connects with amobile computing device, the accessory can send accessory informationthat includes metadata specifying a preferred application. Thisinformation, for example, can be sent during an identification phase,authentication phase, or capabilities phase. In some embodiments, ifpreferred application is not executing on the application and is storedin memory at the mobile computing device, the application can beautomatically launched. In some embodiments, the mobile computing devicecan provide a notice to the user asking the user whether they'd like tolaunch the preferred application, and launch the application if the userresponds affirmatively.

In some embodiments of the invention, if any of the preferredapplications (that is, applications preferred by the accessory) areloaded on the mobile computing device, the mobile computing device canhighlight an icon related to one or each of the preferred applicationson a home screen of the user interface. Thus a user can more easilylocate compatible applications for use with the accessory. For example,when highlighting the application icon, the mobile computing device canchange the color or shade of the icon, wiggle or vibrate the icon,enlarge the icon, change the shape of the icon, change the picture onicon, etc. Any aspect of the icon can be changed.

In other embodiments of the invention, if the preferred application isnot stored or loaded on the mobile computing device, the mobilecomputing device can be directed to a network location, such as anapplication store to download the preferred application. In someembodiments, the metadata can be saved and the preferred application canbe downloaded from a network location at a later time. For example, theapplication can be downloaded when the user directs a web browser orapplication store to a specified network location where the preferredapplication can be downloaded. As another example, the application canbe downloaded when the user has the proper level of wirelessconnectivity to download the preferred application. In some embodiments,the preferred application can be loaded when the mobile computing deviceis coupled with a host computer.

Moreover, in some embodiments, the metadata sent from the accessory tothe mobile computing device can also include an indication specifyinghow to behave when the preferred application does not match anapplication loaded on the mobile computing device. This indication canbe part of a command or message. For example, the accessory can specifythat the preferred application must match an application at the mobilecomputing device and the preferred application must be downloaded tointeract with the accessory. As another example, the accessory canspecify a preferred application, but will interoperate with anyapplication with a compatible application protocol. In this case, themobile computing device can download the preferred application but it isnot required. Moreover, in some cases the mobile computing device canrequest feedback from the user about whether to download the preferredapplication or use a compatible application. As yet another example, theaccessory can specify that mobile computing device never search for ordownload an application from a network location or application store.Moreover, in some situations, the accessory can specify that the usernever be asked whether to download the application. In this scenario,the accessory can operate without interaction with an application at themobile computing device.

In yet another embodiment of the invention, an accessory can be coupledwith a mobile computing device and a first application can be executingat the mobile computing device. The first application can be associatedwith an application protocol that may or may not be compatible withaccessory and the application may or may not be in communication withthe accessory. The accessory can send a command to the mobile computingdevice specifying a second application to execute. This can be initiatedin response to an interaction with a user; for example, from the pressof a button at the accessory from the user. The mobile computing devicecan then execute the second application in response to receiving thecommand. In some embodiments the first application can run in parallelwith the second application. In some embodiments, the first applicationcan be closed and the second application loaded. In some embodiments thecommand can indicate the application by serial number and/or name. Insome embodiments, the command can also specify a network location wherethe application can be downloaded and then executed. Moreover, in someembodiments the accessory can request that the second applicationexecute when no application is executing at the mobile computing deviceor when the operating system is executing at the mobile computingdevice.

While the invention has been described with respect to specificembodiments, one skilled in the art will recognize that numerousmodifications are possible. For example, in certain embodimentsdescribed herein, a port is associated with, at most, one applicationprotocol at any given time. In other embodiments, communications usingdifferent application protocols can be multiplexed on the same port,and/or communications with different applications using the sameapplication protocol can be multiplexed on the same port. In suchembodiments, mobile computing device-protocol commands used fortunneling accessory protocol messages (in either direction) can includea session and/or application protocol identifier to facilitate properhandling of the accessory protocol messages. In one such embodiment,when an application establishes a session associated with a particularaccessory and application protocol, an identifier of that session can beprovided to the accessory using a command of the accessory communicationprotocol. Subsequent mobile computing device-protocol packets (e.g.,tunneling command packets) associated with that session can include thesession identifier. Thus, the accessory can associate any accessoryprotocol messages it may send or receive with a particular session, evenif multiple sessions are concurrently in progress and even ifcommunications related to multiple sessions are multiplexed onto thesame port. The accessory can then maintain separate state informationfor multiple sessions, even if communications for multiple sessions aremultiplexed onto a single port.

Embodiments of the invention have been described that provide an exampleof how an application communication protocol can be used forcommunication between an application and an accessory. In many cases themobile computing device can be agnostic regarding the applicationcommunication protocol. Some embodiments describe schemes whereby theaccessory and/or the application communicate information specifying theapplication communication protocol. Various other techniques can be usedso the accessory and/or the application knows which application protocolto use. For example, the mobile computing device can include a tablewith all the known application protocols. The accessory and/orapplication can specify the application protocol by pointing to thetable entry. As another example, the application can request applicationprotocol information from the accessory using any number ofcommunication protocols. As another example, the application can specifyto the accessory any protocols supported by the application and theaccessory can chose the application protocol to use. As yet anotherexample, a bit mask can be used where predetermined different bitmaskscan be used to represent various application protocols. Various othermeans for identifying the application protocol can also be used.

Circuits, logic modules, processors, and/or other components can bedescribed herein as being “configured” to perform various operations.Those skilled in the art will recognize that, depending onimplementation, such configuration can be accomplished through design,setup, interconnection, and/or programming of the particular componentsand that, again depending on implementation, a configured componentmight or might not be reconfigurable for a different operation. Forexample, a programmable processor can be configured by providingsuitable executable code; a dedicated logic circuit can be configured bysuitably connecting logic gates and other circuit elements; and so on.

While the embodiments described above can make reference to specifichardware and software components, those skilled in the art willappreciate that different combinations of hardware and/or softwarecomponents can also be used and that particular operations described asbeing implemented in hardware might also be implemented in software orvice versa.

Computer programs incorporating various features of the presentinvention can be encoded on various computer readable storage media;suitable media include magnetic disk or tape, optical storage media,such as compact disk (CD) or DVD (digital versatile disk), flash memory,and the like. Computer readable storage media encoded with the programcode can be packaged with a compatible device or provided separatelyfrom other devices. In addition program code can be encoded andtransmitted via wired optical, and/or wireless networks conforming to avariety of protocols, including the Internet, thereby allowingdistribution, e.g., via Internet download.

While examples and/or details are described in this disclosure inrelation to a single embodiment such examples or details can be used inconjunction with any embodiment described herein.

Thus, although the invention has been described with respect to specificembodiments, it will be appreciated that the invention is intended tocover all modifications and equivalents within the scope of thefollowing claims.

1. A method for communicating between an accessory device and anapplication executing on a mobile device, the method operating on themobile device, the method comprising: identifying an accessory device,wherein the identification uses an accessory communication protocol;receiving information from the accessory device specifying anapplication communication protocol, wherein the information is receivedusing the accessory communication protocol; executing an application atthe mobile computing device; and communicating with the accessory devicefrom the application using the application communication protocol. 2.The method according to claim 1, further comprising determining whetherthe application protocol is listed in a protocol table at the mobilecomputing device, wherein the protocol table comprises protocolssupported by applications at the mobile computing device.
 3. The methodaccording to claim 2, further comprising downloading an application thatsupports the application protocol in the event that the protocol tabledoes not include the application protocol.
 4. The method according toclaim 1, wherein the information from the accessory device specifying anapplication communication protocol specifies the one applicationcommunication protocol using a reverse domain name convention.
 5. Themethod according to claim 1, wherein the information from the accessorydevice specifying the application communication protocol also includesan identifier associated with the application communication protocol. 6.The method according to claim 1, wherein the communicating with theaccessory device using the application communication protocol, furthercomprises encapsulating application communication protocol packetswithin accessory communication protocol packets.
 7. The method accordingto claim 1, wherein the application communication protocol includescommands that are included within the accessory communication protocol.8. A mobile computing device comprising: a housing; a communicationinterface disposed at least partially within the housing, and configuredto exchange commands and data with an accessory, the communicationinterface having at least one port; memory disposed within the housing;and control logic disposed within the housing, and communicativelycoupled with the memory and the communication interface, the controllogic being configured to: receive an indication specifying anapplication communication protocol from an accessory through thecommunication interface using an accessory communication protocol;execute an application stored in the memory; and establish communicationbetween the accessory and the application using the applicationcommunication protocol.
 9. The mobile computing device according toclaim 8, wherein the at least one port is a wired or a wireless port.10. The mobile computing device according to claim 8, wherein thecontrol logic is further configured to determine whether an applicationcommunication protocol specified by the application is associated withan application communication protocol stored in memory.
 11. The mobilecomputing device according to claim 8, wherein the control logic isfurther configured to tunnel application communication protocol data tothe accessory using the accessory communication protocol.
 12. The mobilecomputing device according to claim 8, wherein the control logic isfurther configured to encapsulate an application communication protocolpacket with an accessory communication protocol packet and to providethe accessory communication protocol packet to the port.
 13. A mobilecomputing device, comprising: a housing; a communication interfacedisposed at least partially within the housing, and configured toexchange commands and data with an accessory; memory disposed within thehousing; and control logic disposed within the housing, andcommunicatively coupled with the memory and the communication interface,the control logic being configured to: receive application communicationprotocol information from an accessory device through the communicationinterface, wherein the application communication protocol informationincludes an identification of an application communication protocolsupported by the accessory, and wherein the application communicationprotocol information is received from the accessory using an accessorycommunication protocol; create encapsulated packets by encapsulatingapplication communication protocol packets within accessorycommunication protocol packets; and send the encapsulated packets to theaccessory via the communication interface.
 14. The mobile computingdevice according to claim 13, wherein the communication interface is awireless communication interface.
 15. The mobile computing deviceaccording to claim 13, further comprising a protocol table stored in thememory, wherein the protocol table includes a listing of applicationprotocols supported by applications installed on the mobile computingdevice.
 16. A computer-readable medium containing program instructionsthat, when executed by a processor of a mobile computing device, causethe processor to execute a method comprising: receiving applicationcommunication protocol information from an accessory device using anaccessory communication protocol; receiving data from the accessoryusing the application communication protocol; and manipulating the datareceived from the accessory.
 17. The computer readable medium of claim16, wherein the method further comprises displaying at least a portionof the manipulated data at a display of the mobile computing device. 18.The computer readable medium of claim 16, wherein the method furthercomprises controlling the functionality of the accessory by sendingcommands to the accessory using the application communication protocol.